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Highlights of a followup study involving 1,179 


-* remedial reading students in Rhode Island, grades 2 and 4, were. 


‘examined. Since the study focused on deternining the effect of Title 
I programs beyond one school year, the saaple included students who 
did and did not continue to receive Title I services. It was not 
possible to determine whether each student had received these — 
services prior to the study. Findings were based on the assumption 
that without Title I intervention, standard scofes on the- California 
, Achievement Tests would remain at the same percentile from -one 


testing period to the next 


After the first year, students who Tett * 


the program scored significantly higher than their counterparts; both 
groups éxceeded scores expected without Title I. intervention, using 

pretest scores as a‘ basis of comparison. After the second year, using 
first year posttest scores fcr comparison, students were either at ‘or 


below the level expected without treatment. ! 
pretest score as the comparison criterion may be the most reasonabie: Me 
since it is unlikely that disadvantaged students can 


approach, 


Use of the original’ 


maintain rapid rate of achiavemeant gained during intensive remedial 


instruction. 
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Compensatory education programs in Rhode Island, funded under Title I 
* of. the Elementary and Secondary Education Act and Rho e Island State Sec- 


tion 4, have provided a variety of special programs and services for the 


» 


state's students. In fiscal year 1974-75, the larges portion‘of. these 


funds was allocated to remedtal seading services. These progtens. offer 


instruction in all school districts C6 individuals o en groups of. 
children, based upon a dlanitowid c-otesertptive model nder this approach 
¥ 


Individualized programs for each student are then veloped ‘in: order to 


build upon the child's strengths and remediate his or her weaknesses. 


° 


The Tenth Annual Evaluation of Title I for the| fiscal year 1974-75 


by the Rhode Island Department of Education included an sdeesuent of She Ge 
effectiveness of remedial reading services provided eee that year: This 
investigation cpesents the highiteute oe a follow-up study of the reading 
achievement of children who were enrolled as Title |I/Section 4 remedial 
reading programs during the school year ro7h- 75. ‘The study was deuducked 

' during Spring of 1975-76 schdol year, and nuedigued both children who re- 
mained in Title a ial 4 programs during 1975- 76 and children who were 


no longer Beer: in such programs. The study included those children who 


were in grades 2 and 4 in 1974-75 and assessed thelr performance in this 


iy 
a 


ae the following year. / 


xe 


Purpose _ _ . _  ¢ 


| e 


The principal focus ef this study was to determine the effect of 


Title I programs beyond a single year. .For this reason the selected 


_ sample includes both students who-were in the program for both years and 
4 | P, 


each student's skills are evaluated and particular eaknesses are identified. 


. 
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those who did not continue in the program beyond the first year. For the 


, 
. 
a 


purposes of’ the study, these groups are referred to as the "Two-Year Group" 


and "One-Year Group" respectively. It should be noted, however, that no 


reference is made to whether or not students received Title I services’ 
arevinls to the 1974-75 school year. 9. 

Given the remedial nature of the service provided by the Title I 
program, one would expect that as so sain ofy program participation both‘ 
groups would show greater gains in reading doliieveweit during the first 

_ year than would be expected on the basis of eutinatien and normal classroom 


instruction alone. The,research questibn addressed is whether, during the 


follow-up year, the One-Year Group maintains gains made in the fikst year 


s 


, after leaving the Title I program, and whether the Two-Year Group continues 


“ye 


Y 


*® 


- Section 4 in Rhode’Island during the academic year 1974-75. The follow-up 


to show improvement: in reading achievement. ' \ 


METHOD 
\ 


Sample 


Participants in t tudy were second-and fourth-grade students 


identified as receiving femedial reading services under Title I and State 


study included children who received remedial services in the 1974-75 year 


% 


siione and those who received services in both 1974-75 and 1975-76. 

It should be néted that those students referred to as second~graders were ’ 
+ in the. second grade during 1974-75 and in the third grade in 1975-76. 

Similarly, the fourth-graders were in the £ourch grade during the first 


’ 


year and tn the fifth grade during the ee year. . 


s 
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Table 1 shows the number of students who participated:in each grade 


and in each research group. The reading achievement scores for all 1,179 


students were analyzed in the course of the study. ‘ 
’ 
TABLE. 1 
Number of Students Participating in the Study v = 


by Reconeehi eo and Grade Level 


GRADE LEVEL TOTAL 
TITLE I STATUS 2 5 

‘ = “ ' = ' 
Two-Year Group: 294 174 - 468 
One-Year Group 389 ed 711 
TOTAL 6aa* + + 496 ‘5 1179 


Instrumentation. 


‘The instrument adopted for the assessment of reading achievement 
was the california Achievement Test (CAT). The CAT, eines yields a 


vocabular dnd bodpeohduaton score as well as a Composite ‘of the two, is 
\ ’ 


the test whith is traditionally administered each year to students in- 


-* 


. Title I programs on‘a pre-post basis in the course of program participation. 


‘ ’ . 
According to publishérs' specifications, performance on the CAT was 
«°° | 
analyzed in terms of percentile ranks and Achievement Development Scale 
Scores (ADSS), which are a form of standard score. For purposes of the - 


dl \ 
study, all raw scores were converted to percentile and ADSS scores sing 


ap 2 " 
publishers’ norming tables for the appropriate level, form, and period of 
. . P 


administration. - 


: Data Analysis 


All of the analyses conducted involve comparisons between groups, 
either between the Two-Year and One-Year Groups at a piscncnetae in time, 
or between a group and itself at two different points in eine; The basic [ 
data tdenedtene variables) for all analyses are the Achievement Develop- | 
ment’ Scale Scores (ADSS) for the Vocabulary and Comprehension subtests of 
the CAT and the composite score from the same test. It shoul be noted 


_ that while the raw composite score is a simple sum of. the Vocabulary and 
: ) . ; 


Comprehension raw scores, the derived ADSS for the composite is not a 


- 


simple sum of the two subtest ADSS scores. To assess differences between 
- , \ 4 ? ‘ 


observed score two types of analysis were employed in assessing the ae 


- 


A . ; 
differences between observed scores-analysis of variance and analysis of 


covariance. These analyses determine the statistical significance of 


differences between sets of scores. They were employed in evaluating 

the comparisons between groups and between the achievement levels sb 
group at different points in tdme. In addition, a part used to 
assess the difference between predicted (expected). and observed scores for 
each, student group. For each of these analyses, the predicted ‘score te 
based on the students' expected achievement without remedial reading . : 
services. Operationally, this involves the qaemipeise that without 

Title I services, the average ADSS of the group will remain at the same 


percentile level from one testing period to the next. Thus, the predicted. ar 


ADSS scores are based upon consideration of the pércentile rank of this . 


ef 


particular group at a time prior to a posttest. 
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ar | | RESULTS a 7 ie ae? | 

A summary se ates findings is presented here kecause of the magni- . | 
tude and complexity of the gnaivens! Complete analysis information is- . | 
svatlaniie in the technical results report for y ia study. 


' * . 


~*~ Differences Between Groups 


. While there were generally small insignificant differences in reading 


achievement at prétest time, by the end of the 1974-75 school year the 


One-Year Group scored significantly higher than the Two-Year Group on 
most measures. | _ 
: j 


: a almost every case the Two-Year and One-Year Groups were virtually — 
identical in reading sateen at the end of the follow-up year, 
1975-76. ° | | 14 . 
ae ; | , ot 


Differences Between Predicted and Observed Seores 


. Both groups significantly exceeded the scores that would have been 


‘ expected without Title I intervention on every measure‘ except“ one 


‘ 


“a during the first year, 1974-75, when the ‘pretest scores were used to . 


‘ @ 


< = - 
derive the no-treatment expectation. L 


paris the second year, 1975-76, the second+ (then third-) graders 5 elf 
scored at the level expected without program intervention for both / ) 
; ks | 


| 7 
igroups.- For fourth- (then fifth-) graders, the Two-Year Group was at 


- / 
the level expected without treatment, while the One-Year Group was 


below the expected level. For these analyses the higher end of the 


-first year posttest score was used as the predictor for the no-treatment 


) 
~ 
A os 


expectation. | 


base” 3 


‘ 


. Across the two-year period of this study, students in both groups 
exceeded the achievement which would have been expected on the basis of 


‘ y 
the pretest (before-treatment) scores. 


. e , 
\ Lee | ‘. : ri . F) 
Oe Differences Across Groups Over Time ae * * ’ . 
- Students; in both groups continued to gain in absolute achievement 


; q ‘ ! : 
(Achievement Development Scale Scores) throughout the two years of the 


- 


study. More rapid Macebaaee were evident in the first year (1974-75) 
with slower gain rates o¢curing in the second year, 

; In terms of relative achievement, students in both groups achieved. 
substantially diphae percentile scores than they did upon entering the 


program. However, when end of first year percentiles are used as‘the 


baseline, end of second year percentiles are lower in both groups, than 


at the end of the first year. 


an*® 


' first year used as the basis of comparison or prediction, the results 


depending on which score is used to derive a no-treatment. An additional 


DISCUSSION 
The data indicated that positive results have occurred in Rhode 
Island compensatory education reading programs over a two year period. 
Students increased in‘ absolute achievement measures over the two yeubes 
and, across the hg year period, , exceeded what would sa been expected 


if students had not received compensatory: education instruction. 1 


the second year is reviewed in isolation, with the posttest of the 


become more Giese Students did not exceed the predicted levels when 
the higher first posttest score was used to antive the no-treatment 
Pxpeeyartcn nor did they maintain the percentile rank that had been 
achieved: during the first year. 

Several papers presented at the recent American Educational Research 
Assotation Convention in ‘ea 1977, indicated that using the, original 
pretest score as the predictor or criterion may be the most reasonable 
approach since it is highly unlikely that severely disadvantaged 
students will be able to maintadn the rapid rate of gain achieved 
during intensive remedial instruction. A study (DeVito and. Long) indi- 
cated dramatic drops in achievement percentiles among Title I students : 
during the summer. ‘They attributed this drop to forgetting due to 


disuse of skills as well as crossing levels of the testing instruments. 
D4 « 

A further study (Pelavin and David) also found these dramatic summer 
drops for disadvantaged students and pointed to the fact that very 


different interpretations of "success" in a program could be made 
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oe 


investigation by Ozenne found similar results and mentioned similar 


problems.. .- om 


\s 
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The results of this study should be viewed in light of the following’ |” 


cautions and limitation. 


1) 


2) 


33° 


4) 


5) 


6) 


While the study categorized students as members .of either the 
One-Year or Two-Year Group for analysis purposes, it should be 


noted that this categorization pertains only to the two school 


‘'years involved, 1974-75 and 1975-76. It was'not possible to 


va 


Scticitigt tas dusk sendene the number of years he or she fad 
received Title I/Section 4 services prior to the 1974-75 school 
year. | | 

The study refers to reading santana Se only and should not be 
used to make inferences about the effectiveness of compensatory 
areas such as mathematics, language arts, oe obned instructional 


areas. . ; , , 


Second pretest-scores were unavailable so the magnitude of summer 


drop is unknown. 

The California Achievement i. is a general, norm-referenced 
tcmemi ant and may not adequately reflect the different objectives 
of different Title I/Section:4 reading programs. 

the data should not be generalized beyond-the grades included: 


in this study and are not statistically generalizable beyond: the 


4 ! 
\ 


state of Rhode Island. 


Students who were exited from the program after one year exhib- 


¢ 


ited,*as a group, higher scores than the group that remained for 
two years. This study does not provide any information about \ 
the nature and approach of the instruction the child returned 

¥ i ¥ 


. 


to upon release from compensatory programs. \ ae 


are a — 


e?: oe 4 52 . ‘ee 


be , 7) No information can be provided about, the achievement of the 


One-Year Group had they been allowed to receive a second year 
of service. | €. ; ae 
8) “The results of thts study do ae provide information on the 

| effects over a longer time period. This study is a orie-year” 


, , follow-up examination. 
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